AMENDMENTS TO THE CLAIMS 

The following listing of claims will replace all prior versions and listings of claims 
in the application. 

Listing Of Claims 
1 . - 25. (Canceled) 

26. (Currently Amended) A method for automatically registering a sensed 
image with a reference image, comprising: 
s e l e cting a typ e of s e nsor; 

acquiring an image of a scene with [[the]] a sensor mounted on a platformr-the 
i mag e in c l ud i n g and at least one sensor parameter that indicates a perspective of the 
sensor relative to the scene; 

determining a center of the scene in the sensor image based on a coordinate 
system associated with a reference image database and a digital elevation database; 

accessing the digital elevation database to obtain a geocoded reference digital 
elevation model whose geographic extent encompasses an area around the center of 
the scene in the sensor image; 

accessing the reference image database to obtain a geocoded reference image 
that encompasses an area around the center of the scene in the sensor image; 

generating a synthetic 3-D model of the area around the center of the scene by 
combining the geocoded reference digital elevation model and the geocoded reference 
image such that each pixel of the geocoded reference image is associated with an 
elevation from the geocoded reference digital elevation model; 
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transforming the synthetic 3-D model into a synthetic perspective image of the 
scene based on the type o f s on sor se le c ted a type of the sensor and the at least one 
sensor parameter; and 

registering the sensor image of the scene with the synthetic perspective image to 
geocode the sensor image using a mutual information model. 

27. (Currently Amended) The method of Claim 26, wherein s e l e ct i ng a type of 
the sensor further comprises at least one of the following: a pinhole camera, a lens 
camera, and a synthetic aperture radar sensor or combinat i ons ther e of . 

28. (Previously Presented) The method of Claim 26, wherein the at least one 
sensor parameter further comprises a plurality of sensor parameters that include at 
least a field of view of the sensor, size of the image in pixel units, a resolution of the 
image, a focal length, an elevation angle and an azimuth angle. 

29. (Currently Amended) The method of Claim 28, wherein registering the 
sensor image of the scene with the synthetic perspective image further comprises: 

determining a projection for the sensor image based on th e typ e of s e nsor 
selected the type of the sensor and the plurality of sensor parameters; and 

determining an inverse projection for the sensor image based on the type of 
s e nsor s e l e ct e d the type of the sensor a nd the plurality of sensor parameters. 
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30. (Previously Presented) The method of Ciaim 26, further comprising: 
determining a location of the sensor relative to the scene; 

determining projection parameters for the perspective of the sensor relative to 
the scene based on the location of the sensor relative to the scene and the center of the 
scene; and 

determining an inverse projection for the perspective of the sensor relative to the 
scene based on the location of the sensor relative to the scene and the center of the 
scene. 

31 . (Previously Presented) The method of Claim 29, wherein accessing the 
reference image database further comprises: 

retrieving reference data that includes a perspective of the reference image 
relative to the scene; and 

retrieving a reference projection model for the reference image. 

32. (Previously Presented) The method of Claim 31 , wherein transforming the 
synthetic 3-D model into the synthetic perspective image further comprises: 

determining a projection of the reference image based on the reference data and 
the reference projection mode!; and 

determining an inverse projection of the reference image based on the reference 
data and the reference projection model. 
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33. (Previously Presented) The method of Claim 32, further comprising: 
using the inverse projection of the reference image to remove projective 

distortion from the reference image. 

34. (Previously Presented) The method of Claim 32, further comprising: 
transforming the synthetic 3-D model into an orthographic projection using the 

inverse projection of the reference image. 

35. (Previously Presented) The method of Claim 32, wherein the projection 
parameters for the perspective of the sensor define a sensor projection model, and the 
sensor projection model and the reference projection model are the same projection 
model. 

36. (Previously Presented) The method of Claim 32, wherein the projection 
parameters for the perspective of the sensor define a sensor projection model, and the 
sensor projection model and the reference projection model are different projection 
models. 
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37. (Previously Presented) The method of Claim 32, wherein registering the 
sensor image of the scene with the synthetic perspective image further comprises: 

determining a translation offset between the sensor image and the synthetic 
perspective image; and 

matching pixels in the sensor image to pixels in the synthetic perspective image 
using the translation offset. 

38. (Previously Presented) The method of Claim 37, wherein matching pixels 
in the sensor image to pixels in the synthetic perspective image further comprises: 

matching pixels in the sensor image to pixels in the synthetic perspective image 
using the inverse projection of the perspective of the sensor. 

39. (Previously Presented) The method of Claim 26, wherein registering the 
sensor image further comprises: 

associating the geocode of a pixel in the reference image with the geocode of a 
pixel in the sensor image to geocode the sensor image. 
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40. (Currently Amended) A method for automatically registering a sensed 
image with a reference image, comprising: 
s e l e cting a typ e of sensor; 

acquiring an image of a scene with [[the]] a sensor mounted on a platform, the 
image including at least one sensor parameter that indicates a perspective of the sensor 
relative to the scene; 

determining a center of the scene in the sensor image based on a coordinate 
system associated with a reference image database; 

accessing the reference image database to obtain a geocoded reference image 
that includes a portion of a right stereo image and a portion of a left stereo image, which 
encompasses an area around the center of the scene in the sensor image; 

processing the left and right stereo images to derive a geocoded reference digital 
elevation model whose geographic extent encompasses an area around the center of 
the scene in the sensor image; 

generating a synthetic 3-D model of the area around the center of the scene by 
combining the geocoded reference digital elevation model and the geocoded reference 
image such that each pixel of the geocoded reference image is associated with an 
elevation from the geocoded reference digital elevation model; 

transforming the synthetic 3-D model into a synthetic perspective image of the 
scene based on the type of s o nsor s ele ct e d a type of the sensor and the sensor 
parameter; and 

registering the sensor image of the scene with the synthetic perspective image to 
geocode the sensor image using a mutual information model. 
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41 . (Currently Amended) The method of Claim 40, wherein s e l ecting a type of 
the sensor further comprises one or more of the following: a pinhole camera, a lens 
camera, and a synthetic aperture radar sensor or combinations th e r e of . 

42. (Previously Presented) The method of Claim 40, wherein the at least one 
sensor parameter further comprises a plurality of sensor parameters that include at 
least a field of view of the sensor, size of the image in pixel units, a resolution of the 
image, a focal length, an elevation angle and an azimuth angle. 
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43. {Currently Amended) The method of Claim 42, wherein registering the 
sensor image of the scene with the synthetic perspective image further comprises: 

determining a projection for the sensor image based on the type of sensor 
se l e cted and the plurality of sensor parameters; and 

determining an inverse projection for the sensor image based on the type of the 
sensor s ele cted and the plurality of sensor parameters. 

44. (Previously Presented) The method of Claim 40, further comprising: 
determining a location of the sensor relative to the scene; 

determining projection parameters for the perspective of the sensor relative to 
the scene based on the location of the sensor relative to the scene and the center of the 
scene; and 

determining an inverse projection for the perspective of the sensor relative to the 
scene based on the location of the sensor relative to the scene and the center of the 
scene. 

45. (Previously Presented) The method of Claim 44, wherein accessing the 
reference image database further comprises: 

retrieving reference data that includes a perspective of the reference image 
relative to the scene; and 

retrieving a reference projection model for the reference image. 
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46. (Previously Presented) The method of Claim 45, wherein transforming the 
synthetic 3-D model into the synthetic perspective image further comprises: 

determining a projection of the reference image based on the reference data and 
the reference projection model; and 

determining an inverse projection of the reference image based on the reference 
data and the reference projection model. 

47. (Previously Presented) The method of Claim 46, further comprising: 
using the inverse projection of the reference image to remove projective 

distortion from the reference image; and 

transforming the synthetic 3-D model into an orthographic projection using the 
inverse projection of the reference image. 

48. (Previously Presented) The method of Claim 46, wherein registering the 
sensor image of the scene with the synthetic perspective image further comprises: 

determining a translation offset between the sensor image and the synthetic 
perspective image; and 

matching pixels in the sensor image to pixels in the synthetic perspective image 
using the translation offset. 
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49. (Previously Presented) The method of Claim 48, wherein matching pixels 
in the sensor image to pixels in the synthetic perspective image further comprises: 

matching pixels in the sensor image to pixels in the synthetic perspective image 
using the inverse projection of the perspective of the sensor. 

50. (Previously Presented) The method of Claim 40, wherein registering the 
sensor image further comprises: 

associating the geocode of a pixel in the reference image with the geocode of a 
pixel in the sensor image to geocode the sensor image. 
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